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DETAILED ACTION 

1 . The Examiner noted that a preliminary amendment was filed on January 3, 2008, 
prior to the mailing date of the Office Action mailed on January 1 1 , 2007. Therefore, this 
Office Action is meant to replace the Office Action mailed on January 1 1 , 2007. 

2. The Examiner placed a phone call to Gianni Minutoli (Attorney on Record) to 
indicate that another to explain the situation and to indicate that this Office Action would 
be made to replace the Office Action mailed on January 1 1 , 2007 so that the Applicants 
do not need to respond to the Office Action mailed on January 1 1 , 2007. 

Response to Amendment 

3. The Examiner acknowledges the preliminary amended claims filed on January 3, 
2008. Claims 35, 37, 38, 40 and 42 have been amended. Claims 1-25, 29, 36, 39 and 
49-56 have been canceled. 
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Claim Rejections - 35 USC § 102 

4. The following is a quotation of the appropriate paragraphs of 35 U.S.C. 1 02 that 
form the basis for the rejections under this section made in this Office action: 

A person shall be entitled to a patent unless - 

(a) the invention was known or used by others in this country, or patented or described in a printed 
publication in this or a foreign country, before the invention thereof by the applicant for a patent. 

5. Claims 26-28, 30-35, 37, 38, 40 and 44-48 are rejected under 35 U.S.C. 102(a) 
as being anticipated by Denyer et al., WO 97/20434. 

Regarding claim 26, Denyer et al. discloses an imager (See figs. 3 and 4), 
comprising: a semiconductor substrate (by teaching that the imaging array is located in 
a chip, Denyer et al. discloses a semiconductor substrate; see page 13, lines 1-22); an 
array of photosensitive sites (fig. 3 shows an array of pixels 2) located on the substrate, 
the array including a plurality of first photosensitive sites (the array in Denyer et al. is 
divided into three kind of photosensitive sites (red, green and blue); see fig. 2; page 10, 
line 23 - page 12, line 32), wherein each first photosensitive site is configured to 
measure the level of a first spectral component (i.e. green light) in light received by the 
respective first photosensitive site, and a plurality of second photosensitive sites (the 
array in Denyer et al. is divided into three kind of photosensitive sites (red, green and 
blue); see fig. 2; page 10, line 23 - page 12, line 32); a line decoder (16 and 18 as 
shown in fig. 3) formed on the substrate and having at least one serial output for 
transferring out at least one line of measured spectral components from the array during 
a read out operation (page 1 1 , line 1 - page 12, line 25); and an interpolator (Denyer et 
al. discloses a processing unit (Fig. 4: 28) to perform color interpolation to the red, 
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green and blue signals to form synchronous, parallel color channel signals for the video 
signal before being output to a display unit (Fig. 4: 30); page 1 1 , line 33 - page 1 2, line 
25) located in the substrate (Denyer et al. discloses that the processing unit can be 
incorporated in the same chip, where the imaging array is located; page 13, lines 1-22) 
and configured to estimate the level of the first spectral component in the light received 
by at least one of the second photosensitive sites based on at least one measurement 
of the first spectral component obtained respectively by at least one of the first 
photosensitive sites in the at least one line transferred out during the read operation 
(Denyer et al. discloses reconstructing the image colors of each pixels by performing 
interpolation to obtain an RGB value for each pixel location) (Page 10, line 23 - page 
13, line 22). 

Regarding claim 27, limitations can be found in claim 26. 

Regarding claim 28, each second photosensitive site is configured to measure 
the level of a second spectral component in light received by the respective second 
photosensitive site (taking in consideration green as a first spectral component for 
examining purposes, the second spectral components can be read as red. Denyer et 
al. discloses measuring red, green and blue colors as discussed in claim 26 above), and 
the interpolator is further configured to estimate the level of the second spectral 
component in the light received by at least one of the first photosensitive sites based on 
at least one measurement of the second spectral component obtained respectively by at 
least one of the second photosensitive sites in the at least one line transferred out 
during the read operation (Denyer et al. discloses a processing unit (Fig. 4: 28) to 
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perform color interpolation to the red, green and blue signals to form synchronous, 
parallel color channel signals for the video signal before being output to a display unit 
(Denyer et al. inherently teaches that to interpolate the color for a position where a 
second color is measured, colors representative of said first color (i.e. green) are used 
to perform color interpolation in order to form synchronous, parallel color channel 
signals for the video signal before being output to a display unit) (Fig. 4: 30); page 1 1 , 
line 33 -page 12, line 25). 

Regarding claim 30, Denyer et al. discloses a plurality of third photosensitive 
sites (i.e. measuring blue) (Denyer et al. discloses measuring red, green and blue colors 
as discussed in claim 26 above), and the interpolator is further configured to estimate 
the level of the first spectral component in the light received by at least one of the third 
photosensitive sites based on at least one measurement of the first spectral component 
obtained respectively by at least one of the first photosensitive sites in the at least one 
line transferred out during the read operation, and to estimate the level of the second 
spectral component in the light received by at least one of the third photosensitive sites 
based on at least one measurement of the second spectral component obtained 
respectively by at least one of the second photosensitive sites in the at least one line 
transferred out during the read operation (As discussed in claim 28, (Denyer et al. 
inherently teaches that to interpolate the color for a position where a third color is 
measured, colors representative of said first color (i.e. green) are used to perform color 
interpolation to obtain the values of the first color, and colors representative of said 
second color (i.e. red) are used to perform color interpolation to obtain the values of the 
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second color in order to form synchronous, parallel color channel signals for the video 
signal before being output to a display unit) (Fig. 4: 30); page 11, line 33- page 12, line 

25) ). 

Regarding claim 31, limitations have been discussed in claims 28 and 30 

above. 

Regarding claim 32, limitations can be found in claims 26, 28 and 30 above. 
Regarding claim 33, Denyer et al. discloses an A/D conversion element (fig. 4: 

26) located in the substrate (Denyer et al. discloses that the A/D converter can be 
incorporated in the same chip where the imaging array is located; page 13, lines 1-22; 
page 12, lines 20-25) and configured to receive the at least one line of measured 
spectral components read out from the line decoder and output the received 
measurements as digital values to the interpolator (page 11, line 33 - page 12, line 25), 
and wherein the interpolator estimates the first spectral component levels in the second 
and third photosensitive sites, the second spectral component levels in the first and third 
photosensitive sites, and the third spectral component level in the first and second 
photosensitive sites based on the digital values received from the A/D conversion 
element (page 1 1 , line 33 - page 12, line 25). 

Regarding claim 34, limitations have been discussed in claim 33 above. 

Regarding claim 35, Denyer et al. discloses that the at least one serial output of 
the line decoder (Figs. 3: 16 and 3: 18; see also figs. 6: 45, wherein a read out means 
may comprise a plurality of shift registers) transfers out several sequential lines of 
measured spectral components from the array during each read out operation (Page 14, 
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line 33 - page 15, line 27; using a plurality of shift registers would result in outputting a 
plurality of rows or an image block that would result in speeding up the readout 
process). 

Regarding claim 37, Denyer et al. discloses an imager (See figs; 3 and 4), 
comprising: a semiconductor substrate (by teaching that the imaging array is located in 
a chip, Denyer et al. discloses a semiconductor substrate; see page 13, lines 1-22); a 
plurality of first photosensitive sites (fig. 3 shows an array of pixels 2) located in the 
substrate, wherein each first photosensitive site is configured to measure the level of a 
first spectral component in light received by the respective first photosensitive site (the 
array in Denyer et al. is divided into three kind of photosensitive sites (red, green and 
blue); see fig. 2; page 10, line 23 - page 12, line 32); a plurality of second 
photosensitive sites located in the substrate (the array in Denyer et al. is divided into 
three kind of photosensitive sites (red, green and blue); see fig. 2; page 10, line 23 - 
page 12, line 32), each second photosensitive site is configured to measure the level of 
a second spectral component in light received by the respective second photosensitive 
site (taking in consideration green as a first spectral component for examining purposes, 
the second spectral components can be read as red. Denyer et al. discloses measuring 
red, green and blue colors as discussed in claim 26 above); and an interpolator (Denyer 
et al. discloses a processing unit (Fig. 4: 28) to perform color interpolation to the red, 
green and blue signals to form synchronous, parallel color channel signals for the video 
signal before being output to a display unit (Fig. 4: 30); page 11, line 33 - page 12, line 
25) located in the substrate (Denyer et al. discloses that the processing unit can be 
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incorporated in the same chip, where the imaging array is located; page 13, lines 1-22) 
and configured to receive digital data (output from an A/D converter 26 as shown in fig. 
4; page 11, line 33- page 13, line 23) representing the spectral component levels 
measured in the photosensitivity sites, and to estimate the level of the first spectral 
component in the light received by at least one of the second photosensitive sites based 
on at least one digitized measurement of the first spectral component obtained 
respectively by at least one of the first photosensitive sites (Denyer et al. discloses 
reconstructing the image colors of each pixels by performing interpolation to obtain an 
RGB value for each pixel location) (Page 10, line 23 - page 13, line 22). 

Regarding claim 38, Denyer discloses a plurality of third photosensitive sites 
(i.e. measuring blue) (Denyer et al. discloses measuring red, green and blue colors as 
discussed in claim 26 above), wherein each third photosensitive site is configured to 
measure the level of a third spectral component in light received by the respective third 
photosensitive site (taking in consideration green as a first spectral component and red 
as a second spectral component for examining purposes, the third spectral components 
can be read as blue. Denyer et al. discloses measuring red, green and blue colors as 
discussed in claim 26 above), and wherein the interpolator is further configured to 
estimate the level of the first spectral component in the light received by at least one of 
the third photosensitive sites based on at least one digitized measurement of the first 
spectral component obtained respectively by at least one of the first photosensitive sites 
(As discussed in claim 28, (Denyer et al. inherently teaches that to interpolate the color 
for a position where a third color is measured, colors representative of said first color 
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(i.e. green) are used to perform color interpolation to obtain the values of the first color 
in order to form synchronous, parallel color channel signals for the video signal before 
being output to a display unit) (Fig. 4: 30); page 1 1 , line 33 - page 12, line 25)), the 
level of the second spectral component in the light received by at least one of the third 
photosensitive sites based on at least one digitized measurement of the second spectral 
component obtained respectively by at least one of the second photosensitive sites (As 
discussed in claim 28, (Denyer et al. inherently teaches that to interpolate the color for a 
position where a third color is measured, colors representative of said second color (i.e. 
red) are used to perform color interpolation to obtain the values of the second color in 
order to form synchronous, parallel color channel signals for the video signal before 
being output to a display unit) (Fig. 4: 30); page 1 1 , line 33 - page 12, line 25)), and the 
level of the third spectral component in the light received by at least one of the first 
photosensitive sites and/or at least one of the second photosensitive sites based on at 
least one digitized measurement of the third spectral component obtained respectively 
by at least one of the third photosensitive sites (As discussed in claim 28, (Denyer et al. 
inherently teaches that to interpolate the color for a position where a first or a second 
color is measured, colors representative of said third color (i.e. blue) are used to 
perform color interpolation to obtain the values of the second color in order to form 
synchronous, parallel color channel signals for the video signal before being output to a 
display unit) (Fig. 4: 30); page 1 1 , line 33 - page 12, line 25)). 

Regarding claim 40, limitations can be found in claim 32 and 38 above. 
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Regarding claim 44, Denyer et al. discloses an imaging device (See figs. 3 and 
4), comprising: a display (Fig. 4: 30) for displaying an image on an array of M x N pixels 
(page 11, line 33- page 12, line 25); and an imager (Fig. 3: 1 and 4: 1) which 
comprises a substrate (by teaching that the imaging array is located in a chip, Denyer et 
al. discloses a semiconductor substrate; see page 13, lines 1-22), an M x N array of 
photosensitive sites located on the substrate (fig. 3 shows an M x N array of pixels 2), 
the array including a plurality of first photosensitive sites located in the substrate (the 
array in Denyer et al. is divided into three kind of photosensitive sites (red, green and 
blue); see fig. 2; page 10, line 23 - page 12, line 32), wherein each first photosensitive 
site is configured to measure the level of a first color (i.e. green) component in light 
received by the respective first photosensitive site, and a plurality of second 
photosensitive sites (the array in Denyer et al. is divided into three kind of 
photosensitive sites (red, green and blue); see fig. 2; page 10, line 23 - page 12, line 
32) located in the substrate, wherein each second photosensitive site is configured to 
measure the level of a second color component in light received by the respective 
second photosensitive site (taking in consideration green as a first spectral component 
for examining purposes, the second spectral components can be read as red. Denyer 
et al. discloses measuring red, green and blue colors as discussed in claim 26 above); 
and an interpolator (Denyer et al. discloses a processing unit (Fig. 4: 28) to perform 
color interpolation to the red, green and blue signals to form synchronous, parallel color 
channel signals for the video signal before being output to a display unit (Fig. 4: 30); 
page 11, line 33 - page 12, line 25) located in the substrate (Denyer et al. discloses that 
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the processing unit can be incorporated in the same chip, where the imaging array is 
located; page 13, lines 1-22) and configured to receive digitized color component values 
corresponding to the measurements obtained in the first and second photosensitive 
sites, to estimate the level of the first color component in the light received by at least 
one of the second photosensitive sites based on at least one digitized color component 
value obtained respectively from at least one of the first photosensitive sites, and to 
estimate the level of the second color component in the light received by at least one of 
the first photosensitive sites based on at least one digitized color component value 
obtained respectively from at least one of the second photosensitive sites (Denyer et al. 
discloses reconstructing the image colors of each pixels by performing interpolation to 
obtain an RGB value for each pixel location) (Page 10, line 23 - page 13, line 22). 

Regarding claim 45, limitations can be found in claim 28 above. 

Regarding claim 46, limitations can be found in claims 28, 30 and 35 above. 

Regarding claim 47, limitations can be found in claims 28, 30 and 35 above. 

Regarding claim 48, limitations can be found in claim 28 above. 
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Claim Rejections - 35 USC § 103 

6. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

7. Claim 41 is rejected under 35 U.S.C. 103(a) as being unpatentable over 
Denyer et al., WO 97/20434 in view of Acharya, US Patent 6,091,851. 

Regarding claim 41 , Denyer et al. does not explicitly disclose that the 
interpolator output twenty four bits of color data for each photosensitive site, with each 
color value being represented by eight bits. 

However, Acharya teaches the concept of performing color recovery of imager 
captured by a camera (Fig. 3: 330) using a single sensor having a Bayer pattern color 
filter array in order to obtain a full resolution image from an object (Fig. 3: 340) being 
photographed, wherein the individual color components of each pixel area represented 
by eight bits (in order to represent a color intensity range from 0-255) and the pixels of 
the image after interpolation is performed would have a total resolution of twenty four 
bits (Col. 1, lines 4-48; col. 2, lines 40-52; col. 3, lines 16-41; col. 5, line 26 - col. 6, line 
26; col. 9, lines 1-8). Acharya also discloses that the interpolation method can be 
performed by hardware and firmware and that the interpolation method can be 
performed by the camera processor (Fig. 3: 32) (Col. 10, lines 7-17). 

Therefore, taking the combined teaching of Denyer et al. in view of Acharya as a 
whole, one of an ordinary skill in the art, after appreciating the advantages of the 
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interpolation method of Acharya, would find obvious at the time the invention was made 
to modify the imager of Denyer by having the interpolator output twenty four bits of color 
data for each photosensitive site, with each color value being represented by eight bits. 
The motivation to do so would have been to have a desirable amount of color intensity 
values (256 color intensity values) for each color of each pixel in the image and to better 
represent luminance in recovering missing color components to have the output image 
to better resemble the original color of the object prior to its image capture. 

8. Claims 42 and 43 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Denyer et al., WO 97/20434 in view of Okada, US Patent 6,133,953. 

Regarding claims 42 and 43, Denyer et al. does not explicitly disclose that the 
interpolator includes at least one serial register for storing digital bit values representing 
the spectral component measurements from a photosensitive site being interpolated 
and the photosensitive sites neighboring the photosensitive site being interpolated. 

However, Okada teaches a camera (Fig. 1) having a single imaging element (Fig. 
1: 10) having a color separation circuit (Fig. 1: 100) having a two dimensional register 
(Figs. 1 : 30 and 3: 30) connected to an interpolation processing circuit (Figs. 1 : 34 and 
4: 34), said two dimensional register receiving the digitized color values by an A/D 
converter (Fig. 1 : 48) stored in a frame memory in order to input the color values from a 
block surrounding a particular pixel position where a color value is calculated by 
interpolation (as shown in fig. 3, the registers (302, 304, 306, 308, 310, 312, 314, 316, 
318, and 320) receive serially the color values of the pixels in a block as shown in fig. 
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2A; col. 7, line 16 - col. 8, line 38). Okada also discloses that to interpolate the color 
values for a pixel position, said interpolation digitally weights the values of the color 
being calculated using the color values stored in the two dimensional register (having 
plural serial registers storing the colors values for four lines in a block) based on the 
distance from the color values used for interpolation to the position of the pixel to have 
the colors calculated (Col. 5, line 65 - col. 6, line 19; col. 6, lines 51-65; col. 7, line 16 - 
col. 8, line 38; col. 8, lines 59-65). 

Therefore, taking the combined teaching of Denyer et al. in view of Okada as a 
whole, after appreciating the advantages of having serial registers storing the color 
values for of pixels to be used for estimating the color value of a particular pixel as 
taught in Okada, one of an ordinary skill in the art would find obvious at the time the 
invention was made to modify the imager in Denyer et al. to have the interpolator 
including at least one serial register for storing digital bit values representing the 
spectral component measurements from a photosensitive site being interpolated and 
the photosensitive sites neighboring the photosensitive site being interpolated and to 
estimate a spectral component level for a photosensitive site, the interpolator digitally 
weights the values of the spectral component being estimated, as measured by the 
photosensitive sites providing the measurements and which are currently stored in the 
at least one serial register, based on the distances of the photosensitive sites providing 
the measurements from the photosensitive site for which the spectral component is 
being estimated. The motivation to do so would have been to improve the interpolation 
processing in the imager by serially storing the color values in the registers so that said 
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color values can be access in a parallel by the interpolation circuit thus receiving the 
values needed for calculation at the same time and to accurately calculate the missing 
colors based on the particular position of the colors used for interpolation thus better 
representing the colors and have the output image to better resemble the original color 
of the object prior to its image capture. 
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